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APPARATUS AND METHOD FOR CONTROLLING DISPLAY OF IMAGE 
INFORMATION INCLUDING CHARACTER INFORMATION 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present Invention relates to a multi-window 
display apparatus having a multi-window display- 
function, a data telecast receiving apparatus, a multi- 
winflow display method, a memory, and a program. 
Related Background Art 

Conventionally, character telecast programming for 
transmitting character or graphic data multiplexed over 
normal television broadcasting signals, is implemented 
as one of broadcasting services in the current analog 
broadcasting. 

Currently available character telecast programs 
under service include news, weather forecasting, 
traffic information, travel information, television 
shopping, and so on. Some programs present 
questionnaires to viewers during a telecast. This 
current character telecast programming is done in a 
method of providing one-way information from a 
television station to viewers. 

However, BS digital broadcasting becoming 
available at the end of year 2000 in Japan is scheduled 
to provide the data telecasting with such new services 
as interactive and on-demand multimedia services added 
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to the character telecasting. 

This data telecasting is standardized by 
Association of Radio Industries and Businesses (ARIB) , 
Japan, and the details of data telecasting are 
5 described in the ARIB standard: data telecast encoding 
and transmission methods in digital broadcasting (ARIB 
STD B-24). In the standard, the method of presenting 
the data telecast involves various stipulations to 
retain "standardized presentation." The "standardized 

10 presentation" means that the same presentation as that 
intended by a telecast service provider is presented in 
digital television receivers of all makers, which is 
strongly recommended. 

On the other hand, there are recent television 

15 receivers provided with a multi-window display 

function, e.g., those with a function capable of 
simultaneously receiving two channels and 
simultaneously displaying them on a screen. 

However, in order for the foregoing digital 

20 televisions {digital telecast receiving apparatus) with 
the multi -window display function to adapt to the 
presentation of data telecasting, it becomes necessary 
to modify the window size and layout originally 
intended by the telecast service provider; for example, 

25 it is necessary to convert a window into a scale-down 
display window. 

The reason is nothing but that the data telecast 



presentation is considered on the basis of display over 
a full screen. In this case, where a data telecast 
window consists of a mixture of multimedia information 
items including characters, graphics, pictures, etc., 
the discriminability , particularly, of the character 
information can be heavily degraded with a high 
possibility. 

Methods for avoiding the above problem is 
described in Japanese Patent Application Laid-open No. 
09-093548 (television receivers with the character 
information display function). In this application, an 
imageless region in the screen of the display device is 
effectively utilized so as to display the character 
information decoded by a. character multiplexing and 
data telecast decoder, in the imageless region. 
Furthermore, in the case of a television signal in the 
letter box method where there appear upper and lower 
imageless regions, these imageless regions are gathered 
to either of the upper or lower region and the 
character information is displayed in the imageless 
region so as to facilitate recognition and viewing. 
Making use of the function of presenting display of two 
windows , there is provided means for enabling display 
of the character information on either one window. 
Further, there is another known means of always 
automatically setting a window for display of character 
information at a fixed position, as described in 



Japanese Patent Application Laid-Open No. 09-093505 (a 
television receiver with a character multiplex 
decoder) . This method can be an effective method for 
the character telecasting in the current analog 
broadcasting. 

However, when consideration is given to the multi- 
window display retaining the standardized presentation 
of data telecast, changing the layout of the character 
part while ignoring the standardized presentation as in 
the above avoidance methods, deviates from the 
intention of the broadcast service provider, and there 
are thus desires for further improvement . 

SUMMARY OF THE INVENTION 

it is, therefore, an object of the present 
invention to provide a multi-window display apparatus, 
a data telecast receiving apparatus, a mul ti -window 
display method, a memory, and a program capable of 
improving the visibility of the character area of data 
telecast and the multi-window display for users without 
disturbing the "standardized presentation" of the data 
telecast window intended by the telecast service 
provider, where the data telecast window is displayed 
as one of windows in the multi-window display. 

In order to accomplish the above object, a multi- 
window display apparatus of the present invention is a 
multi-window display apparatus for accepting input of a 



plurality of image data ana combining windows 
corresponding to the respective image data to present 
multi-window display thereof, which comprises 
identifying means for identifying a character 
information area in a said window; contour area 
extracting means for extracting a contour area of the 
character information area thus identified; and display 
changing means for changing a display mode of the 
character information area in said extracted contour 
area when said window is displayed in a scale- down 
state equal to or less than a predetermined size as one 
Of window elements of said multi-window display. 

Further, a data telecast receiving apparatus of 
the present invention is a data telecast receiving 
apparatus for accepting input of a plurality of image 
data from a plurality of picture sources including a 
data telecast and combining windows corresponding to 
the image data to present multi-window display thereof, 
which comprises identifying means for identifying a 
character information area in a data telecast window; 
contour area extracting means for extracting a contour 
area of the character information area thus identified; 
and display changing means for changing a display mode 
of the character information area in said extracted 
contour area when said data telecast window is 
displayed in a scale-down state equal to or less than a 
predetermined size as one of window elements of said 
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multi-window display. 

A multi-window display method of the present 
invention is a multi-window display method of accepting 
input of a plurality of image data and combining 
5 windows corresponding to the image data to present 

multi-window display thereof, which comprises a step of 
identifying a character information area in a said 
window; a step of extracting a contour area of the 
character information area thus identified; and a step 
10 of changing a display mode of the character information 
area in said extracted contour area when said window is 
displayed in a scale -down state not more than a 
predetermined size as one of window elements of said 
multi-window display. 

15 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. l which described of Figs. 1A and IB is a 
block diagram showing a configuration of a data 
telecast receiving apparatus in the first embodiment 
20 Fig. 2 is a flowchart showing a processing 

procedure of multi-window display operation; 

Fig. 3 is a diagram showing a logical address map 
of a memory ; 

Figs . 4A. and 4B are diagrams showing images upon 
25 initialization of multi-window synthesis; 

Fig. 5 is a diagram showing a window configuration 
as a combination of a motion picture with character 



graphical inf ormation; 

Fig. 6 is a diagram showing a presentation image 
of a data telecasting window in multi-window display; 

Fig. 7 is a flowchart showing a processing 
procedure of presentation of data telecasting in multi- 
window display operation; 

Fig. 8 is a front view showing a key layout of 
remote controller 20; 

Fig. 9 is a diagram showing absolute coordinate 
transformation in layout change of the data telecasting 
window ; 

Pig. 10 is a flowchart showing a processing 
procedure of change in presentation of the data 
telecasting window at step S206; 

Fig. 11 is a diagram showing an image in which 
focus processing is effected on a contour area of a 
Character area in a data telecasting window; 

Fig. 12 is a diagram showing an image of a contour 
area displayed in a scale-up state; 

Fig. 13 is a diagram showing images of focus and 
scale-up display in menu-text separation in the second 
embodiment ; 

Fig. 14 is a diagram showing an image of focus 
display with menu and text icons in the third 
embodiment ; 

Fig. 15 is a diagram showing an image in scale-up 
display of a contour area in the fourth embodiment; 
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Fig. 16 is a diagram showing images of transition 
effect in scale-up display of contour areas in the 
fifth embodiment; 

Fig. 17 is a diagram showing images of movement of 
5 contour focus on a character area in the sixth 
embodiment; and 

Fig. 18 is a flowchart showing a processing 
procedure of selection of a focus area in the movement 
of contour focus on a character area. 

10 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Embodiments of the present invention will be 

described below with reference to the drawings. 

First Embodiment 
15 Figs. 1A and IB are block diagrams showing a 

configuration of a data telecast receiving apparatus in 

the first embodiment. 

In Figs. 1A and IB, numeral 1 designates an 

antenna (parabolic antenna), which receives BS digital 
20 broadcasting and CS digital broadcasting. 

Symbols 2a and 2b denote tuners, each of which is 

configured to pass a received signal through a band 

pass filter, a downconverter , or the like and output a 

resultant signal to a demodulation part 3a or 3b. Each 
25 demodulator 3a, 3b effects demodulation processing 

matching a transmission mode, error correction 

processing and others on the received signal and 
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outputs a desired MPEG 2 transport stream to a 
demultiplexer 4a or 4b. 

Each, demultiplexer 4a, 4b separates MPEG 2 picture 
data, MPEG2 audio data, and additional information of a 
5 desired program from the transport stream. The MPEG2 
audio data thus separated is decoded in an audio 
decoder (not shown) to be output ted as an audio signal. 
By connecting an amplifier and loudspeakers thereto, a 
viewer can listen to the audio of the received program. 

10 The MPEG2 picture data separated is decoded in a 

picture decoder 5a or 5b to be converted into a display 
format of the raster scan method and thereafter tt is 
outputted as a telecast picture source to a resolution 
conversion part 7a or 7b. 

15 Further, the separated additional information is 

transferred to a control part 15. Wnen this additional 
information is data telecasting which is scheduled to 
go into service in the BS digital broadcasting, the 
control part 15 interprets the BML script language to 

20 obtain a contents scenario of a multimedia information 
service provider. 

This scenario consists of attributes of structured 
contents (individual data of text, still picture, 
motion picture, audio, and the like, control 

25 information designating locations of tnese individual 

data on the screen, screen control information for 
renewing the screen according to operation of buttons 
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ans others, etc.). 

The control part 15 interprets the attributes of 
the contents and constructs a data telecast window in 
cooperation with image drawing part 18 described 
hereinafter and the picture decoder 5a, 5b. 

When tne additional information is Electrical 
Program Guide (EPG) information, the control part 15 
interprets PSI/SI information to obtain program 
information (e.g., programs, telecasting hours, titles, 
categories, etc.). 

Here the data telecasting will be described 
briefly. With development of digital technology, 
broadcasting systems to provide various digital 
information including telecast signals have also been 
developed in the broadcasting field , and among them is 
a new transmission method called data carousel 
transmission. This Is a method of repeatedly 
transmitting contents files of multimedia service 
attendant to programs, on the MPEG2 transport stream, 
and the receiver acquires any contents file at 
arbitrary timing during telecasting. This permits the 
user to watch latest news, a weather forecast, results 
of professional baseball games, etc. at any convenience 
on demand. Since the receiver incorporates a telephone 
function through a modem, it is feasible to implement 
interactive service while connecting the user with a 
telecast station which permits the user to take part in 



a quiz program, a popularity poll program of movies, 
and so on. 

Numerals 6a and 6b denote input processing parts, 
each of which receives a picture input source from the 
outside. When the received data is an analog signal 
from a computer, each input processing part 6a, 6b 
Incorporates an A/D converter and a Phase Locked Loop 
(PLL) for sampling image data. When the received data 
is a digital signal of Low Voltage Differential 
Signaling (LVDS) or the like, each input processing 
part 6a, 6t> incorporates a decoder thereof and a 
differential buffer. Further, when the received data 
is a composite signal of TV or DVD , each input 
processing part 6a, 6b incorporates an NTSC video 
decoder, a color conversion circuit for converting YUV 
signals to RGB signals, an IT conversion circuit for 
converting interlace scanning to progressive scanning, 
and so on. In either case, the received data is 
converted into the display format of the raster scan 
method and thereafter the data is transferred as an 
external picture source to a post- stage resolution 
conversion part 7c or 7d. 

Each resolution conversion part 7a to 7d performs 
scale-up, scale-down, and 1:1 processes while the 
control part 15 independently sets a resolution 
conversion parameter (a scale -up rate, a scale -down 
rate, weighting filter coefficients for scale-up or 
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scale-down, etc.) for each resolution conversion part, 
based on the display format (the number of display 
lines, the number of dots, the number of colors) and 
the preset multi-window layout information. In the 
present embodiment, the resolution conversion parts 7a 
to 7d also have a function of a bus interface for 
outputting four independent image data to one common 
shared bus 8 . 

Images outputted from the resolution conversion 
parts 7a to 7d are stored via the shared bus 8 into a 
shared memory 10, which Is managed under control of 
memory control part 9 and which has a capacity enough 
for at least one display image window (in the present 
embodiment, at least four display image windows). 

At the same time as it, a synthesizing part 12 
issues memory addresses in the memory of the input 
images to be displayed, to the memory control paxt 9 in 
response to a multi-window management instruction from 
the control part 15. thereby reading the display data 
from the shared memory 10 and implementing final multi- 
windows synthesis. Accesses to the memory, which 
asynchronously occur through the shared bus 8 , are 
managed in scalable fashion by mediation part 11, based 
on their priorities . 

A display control part 13 performs control of 
display driving and conversion of display format 
according to characteristics of a display device 14 in 



synchronism with the frame rate of the display device 
14. The display device 14 may he any device that can 
display an image, without being limited to flat panels 
having the matrix electrode structure (liquid crystal 
displays, plasma displays, etc.) and CRTs. in the 
present embodiment, a high vision display is employed 
in the case of television, and a large screen display 
capable o£ displaying high definition images of SXGA or 
higher is employed in the case of PC. 

Numeral 15 designates the control part for 
controlling the whole system, which incorporates a CPU 
having arithmetic performance, a counter for counting 
the time, peripheral I/O interfaces, and so on. 
Connected to a CPU bus in the control part 15 are RAM 
17 for temporarily saving data, and ROM 16 for storing 
control programs. 

The control part 15 may be constructed of only a 
logic circuit or of a CPU or a media processor capable 
of parallel processing. The control programs may be 
stored in the ROM 16 or may be transferred through the 
peripheral I/O interface from the outside. The ROM 16 
also stores character fonts and others as occasion 
demands, which are used when character information of 
WWW or data telecasting is expanded on a window. 

A modem 21 is connected to the control part 15 to 
permit connection to Internet. The Internet connection 
is not used only for browsing and electronic mail, but 
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also used for interactive communications of data 
telecasting. A remote controller light-receiving part 

19 is also connected to the control part 15. so as to 
be able to accept a command from a remote controller 2 0 

5 through use of infrared light. This remote controller 

20 does not always have to he limited to only the 
normal remote controller, but may also be a keyboard, a 
mouse, a joystick, or the like capable of emitting 
infrared light. 

10 Numeral 18 indicates an image drawing part, which 

is used for generation of an On Screen Display (OSD) 
window, an electronic program guide (EPG) window, and a 
Graphical User Interface (GUI) window such as a data 
telecast window or the like in the shared memory 10 by 

15 use of an acceleration function such as BitBlt , DMA, or 
the like when the control part 15 issues a drawing 
command . 

The operation of the data telecast receiving 
apparatus having the above structure will be described 

20 below. 

(Multi-window display operation) 

Fig. 2 is a flowchart showing the processing 
procedure of multi-window display operation. This 
processing program is stored in the ROM 16 and is 

25 executed by the CPU in the control part 15. When the 
control part 15 detects a power-on signal of power 
supply, it starts processing to carry out 
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initialization processing (step. S101). 

In this initialization processing, the CPU 
acquires initial window layout information (information 
about a start point and an end point for each of 
5 windows to be displayed, information about display 

priorities in the case of overlapping windows, etc.) 
from the ROM 16 and, in the case of a telecast picture 
source, the CPU determines the source format and 
default selection channels. In accordance therewith, 

10 the CPU effects initial setting in the tuners 2a, 2b, 

demodulators 3a, 3b, demultiplexers 4a, 4b, and picture 
decoders 5a, 5b. For the external picture sources, the 
CPU detects types of the external picture sources and 
performs initial setting of parameters for receiving 

.15 the external picture sources in the input processing 
parts 6a, 6b in accordance therewith. 

Based on the window layout information acquired at 
step SlOl, the CPU calculates horizontal and vertical 
scale-up or scale-down rates of each picture source, 

20 determines resolution conversion parameters, and then 
sets the parameters in the respective resolution 
conversion parts 7a, 7b (step S102). 

The CPU then sets memory addresses for writing 
necessary for writing of output of each resolution 

25 conversion part 7a, 7b in the shared memory 10 (step 
S103) . 

Fig. 3 is a diagram showing a logical address map 
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of the memory. In the present embodiment, the shared 
memory 10 is composed of totally five planes, four 
motion picture planes and one plane of GUI+a (a value) 
for GUI data. A memory space equivalent to the display 
5 resolution of the display device 14 is assigned to each 
plane. Accordingly, synthesis for display is not 
implemented at the time of writing Into the shared 
memory 10. Here start addresses #0 to #4 of Fig. 3 are 
mainly transferred to each of the resolution conversion 

10 parts 7a, 7b and the image drawing part 18 and are used 
as offset values of memory addresses in writing address 
generators provided in these parts. 

The CPU sets a background color (or pattern) in 
the multi-window display, in the synthesizing part 12 

15 (step S104). The CPU also sets the display priorities 
acquired at step S101, in the synthesizing part 12 
(Step S105). However, the GUI+a plane has the highest 
priority . 

The CPU then performs display setting of GUI for 
20 multi-window control (step S106 ) . This GUI includes 
all the windows drawn by the control part 15, such as 
the Web window, the EPG window, the data telecast 
window, and so on. Specifically, the control part 15 
issues a drawing command for drawing of GUI to the 
25 image drawing part 18 to write in the shared memory 10 
characters and other data expanded in the bitmap format 
through use of the accelerating function such as DMA, 
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BitBlt, or the like of the image drawing part 18, 
thereby constructing the window. 

In this drawing' operation of GUI data, not only 
the GUI data, but the mask data called the alpha value 
5 is also drawn simultaneously in the shared memory 10. 
This is for the purpose of implementing synthesis Of 
nonrectangular GUI data, alpha blending of GUI and 
motion picture, and so on. 

After that, the CPU performs various settings for 

10 operating the synthesizing part 12, such as setting of 
memory addresses for readout, and the like (step S107). 

The schematic operation of the synthesizing part 
12 will be described below. The synthesizing part 12 
has a horizontal pixel counter and a vertical line 

.15 counter of a display area on the basis of the 

horizontal and vertical synchronizing signals of the 
display device 14 to count scanning of the raster scan 
method in the display period. In accordance with the 
count values, the synthesizing part then constantly 

20 generates the readout address of the GUI+a plane to the 

memory control part 9. The start address #4 of Fig. 3 
is designated as the start address of the readout 
address. By this, the GUI data with the a value is 
read out . 

25 On the other hand, based on the window layout 

information (coordinates of the start point and end 
point in the above display area for each of the 
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broadcast picture #0, broadcast picture #1, external 
picture #0, and external picture #1) set by the control 
part 15, the synthesizing part generates the readout 
address of the corresponding motion picture plane area 
5 of Fig. 3 when the aforementioned counters coincide 
witti the area of each picture source - 

If readout requests are concurrent with each 
other, the synthesizing part selects readout of a 
picture source with the highest priority according to 

10 the display priority information set by the control 
part 15, and does not generate the readout addresses 
except for it. When the synthesizing part determines 
that there is no data to be synthesized, it outputs the 
background data set by the control part 15, without 

15 generating any readout address. This results in 

reading the picture data corresponding to the display 
layout and thus implementing synthesis of picture data. 

The readout of the GUI data and picture data from 
the shared memory 10 is alternately carried out in time 

20 division and, with the GUI data and the picture data, 
selection of the GUI data, selection of the picture 
data, or a blending of the GUI data and the picture 
data is carried out according to the a value, to be 
outputted as final multi-window synthetic data to the 

25 display control part 13. After this initialization. 

the image shown in Fig. 4A or 4B is produced as one at 
initialization of the rnulti -window synthesis. Each of 
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Figs . 4A and 4B is a drawing showing • an Image at the 
initialization of the multi-window synthesis. Fig. 4A 
shows an equivalent display image of four windows with 
GUI. Fig. 4B shows a picture- in-picture display image 
5 of four windows with GUI. 

After this, the CPU awaits occurrence of layout 
change (step S108). When there arises a layout change, 
the CPU determines a layout {step S109) and then 
returns to the processing at step S102. By repeating 

10 the processes at above steps S102 to S107, the layout 
change of the multi-window display is executed. 
(Configuration of data telecast window) 

A drawing method of a data telecast window will be 
described below. In the data telecasting the 

15 transmitted information includes various monomedia of 

motion pictures, audio, and still pictures sent in the 
stream system and various monomedia of still images , 
characters, graphics, etc. sent in the carousel system 
on the MP EG 2 transport stream. Also sent is the 

20 multimedia description language called Broadcast Markup 
Language (BML) for combining the data to implement the 
multimedia expression intended by the telecast service 
provider . 

In the data telecast receiving apparatus of the 
25 present embodiment, the demultiplexer 4a, 4b separates 
these data and transfers files of the monomedia of the 
carousel system, BML documents, etc. to the control 
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part 15 to be saved in the RAM .17 . The mono-media of 
the stream system are transferred to the picture 
decoder 5a, 5b to be decoded there. 

For presenting the data telecast window, the 
5 control part 15 decodes the monoraedia of the carousel 
system and draws elements of the background, character 
data, menu buttons, etc., based on the screen layout 
information described on Cascading Style Sheet (CSS) in 
the BML description , on the GUI+a plane in the shared 

10 memory 10 through use of the function of the image 
drawing part 18. 

Since each of the elements is described with 
detailed characteristics such as a character size, 
color, dimensions, size, display position by absolute 

15 coordinates, etc., the "standardized presentation" can 
be retained. Motion pictures such as telecast pictures 
and the like being the monomedia of the stream system 
are subjected to scale-up or scale-down processing in 
the resolution conversion part 7a, 7b, based on the 

20 designated layout information, if necessary, and 

thereafter are drawn on the motion picture plane #0 or 
on the motion picture plane #1 in the shared memory 10. 

The foregoing layout information presented for the 
data telecast window is outputted from the control part 

25 15 to the synthesizing part 12. The synthesizing part 

12 properly switches the address to the aforementioned 
readout address, based on the layout information, to 
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feed it to the memory control part 9, thereby 
presenting the data telecast window intended by the 
broadcast service provider, as shown in Fig. 5. Pig. 5 
is a diagram showing a window configuration as a 
5 combination of a motion picture with character graphic 
information . 

The character graphic information is comprised of 
character data and menu buttons which can be controlled 
from the remote controller 20. A special attribute 

10 such as a focus property or the like is added to each 
menu button so as to permit selection from the remote 
controller 20. When a menu is selected, a next window 
image is acquired again from the carousel system, the 
procedure similar to the above is carried out, and 

15 thereafter the display is switched to presentation of a 
new data telecast window. In this way, interactive 
scenarios of data telecasting are implemented based on 
the determined procedures . 

( Conf ig\iration of data telecast window in multi-window 
20 mode) 

The above processing is a general example where 
the data telecast window intended by the telecast 
service provider is presented on a full screen of the 
display device 14. The flata telecast receiving 
25 apparatus is configured for the purpose of multi-window 
display of four picture sources at the maximum, as 
described above . 
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Accordingly, consideration has to be given to that 
the data telecast window can be one component of the 
multiple windows. Fig. 6 is a diagram showing a 
presentation image of the (3ata telecast window during 
5 the multi-window display. When four windows are 
independently displayed as in the case of this 
presentation image of the data telecast window during 
the multi-window display, the character part in the 
data telecast window can no longer be expressed in the 

10 character size intended by the telecast service 

provider, so that the viewer cannot discriminate the 
characters with a high possibility. 

The following will describe countermeasures of the 
present embodiment in such case. Fig. 7 is a flowchart 

15 showing the processing procedure of data telecast 

presentation in the multi-window display operation. 
This processing program is stored in the ROM 16 and is 
executed by the CPU in the control part 15. The CPU 
awaits a layout change of the display window (step 

20 S200) . When there arises a layout change of the 

display window, the CPU determines whether the current 
mode is a data telecast receiving mode (step S201). 
When the current mode is not the data telecast 
receiving mode, the CPU sets the normal display of the 

25 multi-window presentation {step S209). After this, the 
CPU returns to the processing at step S200. This 
setting of the normal display of the multi -window 
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presentation is processed according to the 
aforementioned flowchart of the display operation 
processing of Fig. 2. 

When the current mode is judged as the data 
5 telecast receiving mode at step S201 on the other hand, 
i.e., when the user depresses a data telecast select 
button 34 shown in Fig. 8, using the remote controller 
20, the CPU determines whether the current mo<3e is a 
multi-window display mode (step S203). Fig. 8 is a 

10 front view of the remote controller 20 showing the }cey 
layout thereof. 

When it is determined that the current mode is not 
the multi-window display mode, i.e. , when the current 
mode is the normal telecast mode of presenting the data 

15 telecast on a full screen as shown in Fig. 5, the CPU 
assigns the remote controller keys for control of data 
telecasting to those for normal control (step S210). 
Here the remote controller keys for control of data 
telecasting include direction key buttons 30, a 

20 determination key button 31, and a cancel button 32 and 
also include, in addition thereto, color buttons 35 of 
four colors (blue, red, green, and yellow) according to 
the ARIB spec, which are used in only the data 
telecasting . 

25 For example, while moving the focus through use of 

the upper and lower direction key buttons 3 0 out of the 
menu buttons shown in Fig. 5, the user can select an 
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objective menu by depressing the determination button 
31- When the telecast service provider assigns the 
colors of the color buttons to the menus for the 
purpose of permitting simple remote controller 
5 operation of menu selection, the user can select a menu 
by one shot press on a button of a corresponding color 
out Of the color buttons 35. Establishing the 
interconnection between the keys of the remote 
controller and the window in this way refers to 

10 "assigning the remote controller keys for control of 
data telecasting to those for the normal control." 

It is then defcex-mined whether a menu is selected 
through the keys (step S211). When a menu is selected, 
new BML is again acquired from transmission in the 

15 carousel system to renew the data telecast window (step 
S212). When no menu is selected, the CPU directly 
jumps to the processing at step S213. After that, it 
is determined whether an end of the data telecast is 
requested (step S213). When the user depresses the 

20 data telecast select button 34, the CPU assumes at step 
S213 that the end of the data telecast is requested, 
and then returns to the normal display setting to 
display only the picture part in the stream system of 
the motion picture in the data telecast at step S209. 

25 When the end of the data telecast is not requested at 
step S213 on the other hand, the CPU returns to the 
processing at step S211. 
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When it is determined at step S203 on the other 
hand that the current mode is the multi -window display 
mode, i.e., when the user depresses the multi -window 
select button 33 on the remote controller 20, the data 
5 telecast window has to be displayed in a scale-down 

state, as shown in Fig. 6. For this reason, the layout 
of the data telecast window is changed (step S204) . 

Fig. 9 is a diagram showing absolute coordinate 
transformation on the occasion of the layout change of 

10 the data telecast window. The figure shown on the 
upper side of Fig. 9 shows the data telecast window 
where the data telecast is displayed on the full screen 
and in the display resolution intended by the telecast 
service provider. in Fig. 9, a superordinate element 

15 indicates a display area of the entire data telecast 
window and is in 1:1 correspondence to the display 
resolution of the display device 14 herein. In the 
same figure, a subordinate element indicates a drawing 
area of such elements as character data and menu 

20 buttons. In the figure shown on the upper side of Fig. 
9, the origin (0, 0) is set at the left upper corner 
and the superordinate element is defined by a 
coordinate system of absolute coordinates (H, V) using 
the number of horizontal pixels (hereinafter referred 

25 to as H pixels) and the number of vertical lines 

(hereinafter referred to as V lines). In the ARIB 
standard ( cf . ARIB STDB-24 version 1.1, p282), the 
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information about the start point of the Xayout of the 
subordinate element is given as Left: distance (the 
number of pixels) from the left edge of the box of the 
superordinate element and Top: distance (the number of 
5 pixels) from the upper edge of the box of the 

superordinate element. The information about the size 
of the layout of the subordinate element is given as 
Width: width (the number of pixels) and Height: height 
(the number of pixels). The coordinate system of the 

10 present apparatus is also defined in similar fashion. 

Supposing the layout is changed into the multi- 
winflow display to convert (or scale down) the 
resolution at a magnification ratio of (1/M) (M > 0) in 
the horizontal direction and at a magnification ratio 

15 of (1/N) (N > 0) in the vertical direction and change 
the position from the origin (0 ( 0) to a movement 
offset position (Xof f set , Yof f set ) , the coordinate 
transformation upon the layout change of the data 
telecast window is effected as shown in the figure 

20 provided on the lower side of Fig. 9. thereby 
implementing scale-down and movement display. 

At this time, the coordinate transformation of the 
superordinate element results in moving the start point 
to the coordinates (Xof f set , Yof f set ) and converting the 

25 size into (H)/M horizontal and (V)/N vertical. 

The coordinate transformation of the subordinate 
element is carried out according to Equations (1) to 
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(4) below. 

Top* - Yoffset + Top/N ... (1) 

Left' = xoffset + Left/M ... (2) 

Width' = Width/M ... (3) 

Height' = Height/N ... (4) 

The control part 15 transforms each element 
according to the above equations and issues a redrawing 
command to the image drawing part 18 whereupon it can 
present the scaled- down window of the data telecast 
Shown in Fig. 6. Concerning the character size, 
however, the character fonts stored in the ROM 16 have 
to be properly transformed in agreement with the scale- 
clown rate. 

After this , it is determined whether the character 
size is not more than a predetermined size (step S205). 
When the character size is equal to or less than the 
predetermined size, i.e., when the characters are 
judged indiscernible, presentation change processing of 
the data telecast window is carried out in processing 
at a step being a feature of the present embodiment 
(step S206) . It is then determined whether the end o£ 
the data telecast is requested (step S207). When the 
end of the data telecast is requested, the CPU moves to 
the processing at step S209. When the end of the data 
telecast is not requested, it is then determined 
whether the multi-window display layout is changed 
(step S208). When the multi-window display layout is 
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changed, the CPU returns to the processing at step 
S201. When it is not changed on the other hand, the 
CPU returns to the processing at step S206 . 

As described above, the presentation change 
processing at step S206 is repeatedly carried out 
unless step S207 results in determination of the end of 
the data telecast and unless step S208 results in 
change of the multi-window display layout. 

Fig. 10 is a flowchart showing the processing 
procedure of the presentation change of the data 
telecast window at step S206. First, the character 
area is discriminated (step S300). Since the control 
part 15 recognizes the layout information of the data 
telecast window {the information after the layout 
change at step S204 of Fig. 7) and the attributes of 
the respective elements, the discrimination processing 
of the character area can be performed relatively 
easily. In the presentation example of Fig. 5, the 
elements of the menu buttons and the character data 
part are judged to be character areas . 

A contour area is determined for the character 
areas (step S301). In this determination processing of 
the contour area for the character areas, the contour 
area is selected so as to embrace all the character 
areas; in the presentation example of Fig. 5, the 
contour area is a surrounded area in a reverse L shape. 
Further, focus processing is effected on the contour 
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area (step S302). Fig. 11 is a figure showing an image 
in which the focus processing is effected on the 
contour area of the character areas in the data 
telecast window. A characteristic presentation method 
5 herein is that indiscernible character data is not 

displayed and that a focus color is set by using the 
same color as either of the color buttons consisting of 
the four colors (blue, red, green, and yellow} of the 
ARIB spec of Fig. 8. In the example of Fig. 11, the 

10 focus color is set red. 

Then the CPU assigns the remote controller keys 
for control of data telecasting to those for extension 
control (step S303) . This means that the remote 
controller keys for control of data telecasting (the 

.15 direction key buttons 30, determination button 31, and 
cancel button 32, ana the color buttons 35 of the four 
colors (blue, red, green, and yellow) of the ARIB spec 
used in only the data telecasting) and others are 
assigned to extension control keys in a contour focus 

20 presentation state. 

Namely, the remote- controller-associated script in 
the data telecasting is ignored and replaced by a 
characteristic control script. In this state, the 
multi-window display setting is carried out, thereby 

25 presenting the display of Fig. 11 (step S304). 

Then the CPU stays in a wait state before the user 
selects the focus area of data telecasting (step S305) . 
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Specifically, the selection is implemented when the 
user depresses the red button out of the color buttons 
35. When correspondence is made between the color 
button and the focus color in this way, uniformity is 
5 given to the remote controller operation in the control 
of the data telecasting window, thereby implementing 
the simple operation. 

When the focus area is selected, the CPU performs 
scale-up display processing of the focused character 

10 area (step S306). Fig. 12 is a diagram showing an 
image of the contour area displayed in a scale -up 
State. A scale-up method at this time can be either a 
method of displaying the character area bacJc in the 
original size of the data telecasting window, as shown 

15 in Fig. 12, or a method of scaling up the character 
areas to an intermediate size enough for easy 
recognition of the character size in order to minimize 
overlapping portions of the enlarged area over the 
picture source windows of multi -window display. In 

20 either case, on the occasion of carrying out this 
scale-up display processing, the control part 15 
changes the layout of the character areas into one 
after the desired scale-up according to the coordinate 
transformation represented by aforementioned Eqs (X) to 

25 (4). The present embodiment is characterized in that 
the layout is loyally reproduced so as to prevent the 
standardized presentation of data telecasting from 
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being disturbed, as much as possible. 

In this scale-up display state, the remote 
controller keys for controi of data telecasting are 
again assigned to those for normal control (step S307). 
5 Namely, the characteristic control script associated 
with the remote controller is returned to the remote- 
controller-associated script in the normal data 
telecasting. This permits the user to select a menu by 
operation of the remote controller in much the same 

10 manner as the menu selection of the normal data 

telecasting, over the menu buttons in the enlarged 
character area. 

It is then determined whether a menu is selected 
(step S308). When a menu is selected, the CPU renews 

15 the data telecasting window (step S311) and returns to 
the processing at step S300. when no menu is selected 
on the other hand, it is determined whether a cancel 
mode is selected on the cancel button 3 2 of the remote 
controller 20 (step S309 ) . When the cancel mode is not 

20 selected, the CPU returns to the processing at step 

S308 . When the cancel mode is selected on the other 
hand, the CPU terminates the scale-up display 
processing of the focused character area (step S310) 
and returns to step S303 to go back into the contour 

25 focus presentation state of the character areas in the 
data telecasting window of Pig. 11. 

As described above, the present embodiment can 



implement the presentation processing with improved 
discernibility of characters during the multi-window 
display of data telecasting. 
Second Embodiment 

In the first embodiment the contour area was 
determined so as to embrace the control elements of the 
menu buttons and the like and the text element of only 
text information, which were the separate character 
areas, all together, but it can be an extremely large 
area, depending upon the layout configuration of the 
presentation window of the data telecasting. In this 
case, when the separate character areas axe scaled up, 
the enlarged character areas can conceivably overlap 
with the windows of the other picture sources displayed 
in the other multi-window display, which will heavily 
degrade the visibility of the other picture sources. 
In order to prevent it , an improvement is made by a 
further method in the second, embodiment. Since the 
basic processing procedures are similar to those in the 
first embodiment, only differences will be described 
below herein . 

On the occasion of determining the contour area 
for the character areas at step S301 of Fig. 10. 
contour areas are determined separately for the control 
elements of the menu buttons and the like and for the 
text element of only text information in the second 
embodiment. Since the control part 15 can identify the 
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difference of attributes and the layout information, it 
can perform this processing relatively easily. 

At step S302, the CPU executes the focus 
processing over the contour areas. In this focus 
• 5 processing, the areas separated at step S301 are 

focused with respectively different colors. Fig. 13 is 
a diagram showing images of focus and scale-up display 
in separation of the menus and text in the second 
embodiment . A characteristic presentation method 

10 herein is that indiscernible character data is not 

displayed and that the focus colors are set by using 
the same colors as two of the color buttons of the four 
colors (blue, red, green, and yellow) according to the 
ARIB spec shown in Fig. 8, as in the first embodiment . 

15 In the center figure of Fig. 13, the menu area is set. 
red and the text area blue. 

When the user presses the red button out of the 
color buttons 35 at step S305, the CPU performs the 
scale-up display processing of only the menu area of 

20 the focused character area, as shown in the figure on 

the upper Sit3e of Fig. 13, at step S306. When the user 
presses the blue button out of the color buttons 35 at 
step S305, the CPU performs the scale-up display 
processing of only the text area of the focused 

25 character area, as shown in the figure on the lower 
side of Fig. 13, at step S306. 

When either of the character areas is scaled up in 
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this way, it ±s feasible to reduce overlapping regions 
over the windows of the other picture sources displayed 
in the other multiple windows. 
Third Embodiment 
5 . In the second embodiment the focus processing was 

carried out using the different colors separately for 
the control elements of the menu buttons and the like 
and for the text element of only the text information, 
but in this display condition the user might fail to 

10 determine whether the focused area is the menu area or 
the text area - 

Fig. 14 is a diagram showing an image of focused 
display with additional menu and text icons in the 
third embodiment. The control part 15 draws a Menu 

15 icon indicating the menu area and a Text icon 

indicating the text area, in cooperation with the image 
drawing part 18, whereby the user can readily determine 
whether the focused area is the menu area or the text 
area, thus improving controllability on the occasion of 

20 the user's selecting a focused area. 
Fourth Embodiment 

In the first and second embodiments, the character 
area under scale-up display can spread over an 
extremely large region, depending upon the layout 

25 configuration of the presentation window of data 

telecasting. In this case, the character area under 
the scale-up display might overlap largely over the 
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windows of the other picture sources displayed in the 
other multiple windows , which will heavily degrade the 
It-.-- visibility of the other picture sources. In order to 

>''./- solve it, an improvement is made by a further method in 

* 5 the fourth embodiment. 

i J Fig. 15 is a diagram showing an image in scale-up 

display of the contour area in the fourth embodiment. 
In the fourth embodiment, the enlarged area and the 
picture areas of the multiple windows are displayed in 
10 an alpha-blended form. The control part 15 draws an 
yO image with the alpha value on the GUI+a plane in the 

jft shared memory 10 in cooperation with the image drawing 

part 18, whereby the synthesizing part 12 executes 
~ alpha blending, as described in the first embodiment. 

M-- 15 This is able to improve the visibility of the 

pi multi-window picture sources tn the scale -up state of 

r"" the character area even if the enlarged, character area 

overlaps in part over the windows of the other picture 
sources displayed in the other multiple windows. 
20 Fifth Embodiment 

In the first and second embodiments, if the 
focused area is instantaneously scaled down (or up) to 
the original size after selection thereof, it will be 
hard for the user to judge which character area is 
25 scaled up. For paying regard to the standardized 

presentation of the broadcast service provider, it is 
desirable to clearly show the correspondence to the 
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original layout . 

For this reason, a stepped scale-up over a certain 
transition time is carried out on the occasion of 
returning (or scaling up) the character area to the 
5 original size in the £i£th embodiment. Specifically, 

the stepped scale-up is represented by Equations (5) to 
(7) below, where in the scale-up display processing of 
the focused character area at step S306 of Fig. 10, the 
transition time for the stepped scale-up is defined as 

10 T (s), the refresh rate of the display device 14 F 

(Hz), a magnification rate of the character area before 
a scale-up M (times), and a magnification rate of the 
character area after a scale-up N (times). 

The number of scale-up steps = T x F ... (5) 

15 Magnification rate of scale-up step = (M - N)/the 

number of scale-up steps ... (6) 

The result of addition of the scale-up step 
magnification rate of Eq (6) to the current 
magnification rate at every step indicated by Eq (5) 

20 gives the next scale-up magnification rate, as 
represented by Eq ( 7 ) . 

Next scale-up magnification rate = current scale- 
up magnification rate + scale-up step magnification 
rate -•- (7) 

25 Namely, the stepped scale-up within the determined 

transition time can be implemented by carrying out the 
scale-up step at the magnification rate of Eq (6) by 



the number of scale-up steps o£ Eg (5) in synchronism 
with the vertical synchronizing signal of the display 
device 14. 

The control part 15 draws images of the character 
area at different scale-up magnification rates on the 
GUI+a plane in the shared memory 10 in cooperation with 
the image drawing part 18. Pig. 16 is a diagram 
showing images of the transition effect in the scale-up 
display of the contour areas in the fifth embodiment. 
By this, the stepped scale-up effect can be achieved in 
a stepwise manner. 

In this way, the user can readily discriminate 
which character area is scaled up in the scale-up 
display of the character area. 
Sixth Embodiment 

In the second embodiment, the separation of the 
character areas was implemented by determining the 
contour areas separately for the respective attributes, 
e.g., for the control elements of the menu buttons and 
the like, and for the text element of only text 
information , but the contour area can spread over a 
considerably large area, depending upon the layout 
configuration of the presentation window of data 
telecast . 

Fig. 17 is a diagram showing images of contour 
focus movement of character areas in the sixth 
embodiment. The window shown on the upper side of Fig. 
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17 is one picked up from the data telecast window part 
displayed in a scale-down state as one window of the 
multi-widow display, similar to Fig. 6. For example, 
where text areas and menu areas are scattered over the 
5 presentation window of data telecasting, as shown in 
the window on the upper side of Fig. 17, it is 
difficult to group the text areas and the menu areas 
according to their attributes and determine contour 
areas for respective groups. If this were forcibly 

10 done to determine the contour areas and scale up the 
separate character areas, the scale-up character area 
would largely overlap with the windows of the other 
character sources displayed in the other multiple 
windows, which could heavily degrade the visibility of 

15 the other picture sources. 

In order to avoid it, an improvement is made by a 
further method in the sixth embodiment- Since the 
basic processing procedures are similar to those in the 
first embodiment, only differences will be described 

20 below. 

In the determination of the contour area for the 
character areas at step S301 of Fig. 10, the sixth 
embodiment is arranged to separate the character areas 
into the control elements of the menu buttons and the 
25 like and the text elements of only text information and 
determine areas for the respective elements by dividing 
the character areas into a size capable of 



accommodating each element in a rectangular area. In 
the window shown on the upper side of Fig. 17, each of 
the text area and the menu area is divided, into four 
areas . 

Since the control part 15 can identify the 
difference of attributes and the layout information, it 
can perform this processing relatively easily. At step 
S302, the CPU performs the focus processing on the 
contour areas. This focus processing is carried out to 
focus the groups of the areas separated at step S301, 
with their respective colors different from each other 
and focus each area grovip of the same attribute with 
the same color. This image is presented in the window 
shown on the upper side of Pig. 17. 

A characteristic presentation method herein is 
that indiscernible character data is not displayed and 
that the focus colors are set by using the same colors 
as two of the color buttons of the four colors (blue, 
red, green, and yellow) according to the ARIB spec in 
Fig. 8, as in the first embodiment. In Fig. 17. the 
various menu areas are set red and the various text 
areas blue . 

In this state, the control part carries out the 
processing at step S305, which is a feature of the 
sixth embodiment. Fig. 18 is a flowchart showing a 
selection processing procedure of a focused area during 
contour focus movement of the character areas . This 
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processing program is stored in the ROM 16 and is 
executed by the CPU in the control part 15. 

First, it is determined whether the focus color 
for the text areas is selected (step S401). When the 
5 user selects the focus color of the text areas by 

pressing the blue button out of the color buttons 35, 
the remote control keys are assigned to those for focus 
movement of the text areas (step S402). Specifically, 
the remote controller keys are assigned so as to be 

10 able to move the focus among the four separate text 
areas with the direction key buttons 30. 

The CPU awaits user's selection of a direction key 
{step S403). When the user selects a direction key, 
the focus is moved to the text area of the designated 

.15 direction key (step £404). On the window shown on the 
lower side of Fig. 17,' left and right movement is 
implemented by tne left and right keys out of the 
direction keys, while the up and down movement by the 
upper and lower keys out of the direction keys. It is 

20 noted that the correspondence between the movement 
directions and the direction keys is not limited to 
this method. 

The focus on the area of the focus movement 
destination is made discernible from the focus color 

25 before the focus movement and turns the area into an 

active state in which it is presently selected. On the 
window shown on the lower side of Fig. 17, the focus in 
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the active state ±s indicated by blue bold focus. It 
is also noted that the focus method of this active 
state is not limited to this . 

After this focus movement, it is determined 
5 whether the user selects an area desired to display in 
the scale-up state by depressing the determination 
button 31 (step S405) . When an area desired to display 
in the scale-up state -Is selected, the processing is 
terminated. When it is not selected on the other hand, 
10 the CPU returns to the processing at step S403. 

After this, the CPU carries out the aforementioned 
scale-up display processing of the focused area at step 
S306 of Fig. 10. This scale-up display can be done in 
a minimum area in which the user desires to scale up 
15 the focused area. 

When the focus color of the text areas is not 
selected at step S401 on the other hand, the CPU 
determines whether the focus color of the menu areas is 
selected (step S406). When the focus color of the menu 
20 areas is not selected, the CPU returns to the 
processing at step S401. 

When the focus color of the menu areas is selected 
on the other hand, the CPU carries out the processing 
at and after step S407, and the focus movement 
25 processing of menu areas at these steps S407 to S410 is 
similar to the processing at steps S402 to S405- 

Namely, when the user selects the focus color of 
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the menu areas by depressing the red button out of the 
color buttons 35, the remote controller keys are 
assigned to those for the focus movement of the menu 
areas (step S407). 
5 The CPU awaits user's selection of a direction key 

(step S408). When the user selects a direction key, 
the CPU moves the focus to the text area of the 
designated direction key (step S409). After the 
movement of focus, it is determined whether the user 

10 selects an area desired to display in the scale-up 

state by depressing the determination button 31 (step 
S410). When the user selects an area desired to 
display in the scale-up state, the processing is 
terminated. When the user does not select any area on 

15 the other hand, the CPU returns to the processing at 
step S408. 

This can decrease the overlapping regions over the 
windows of the other picture sources displayed in the 
other multiple windows, in the scale-up state of the 
20 character area, independent of the layout of the data 

telecast . 

The above described the embodiments of the present 
invention, but it is noted that the present invention 
is not limited to the configurations of these 
25 embodiments and can also be applied to any structure 
that can achieve the functions stated in the scope of 
claims or the functions in the configurations of the 



embodiments . 

For example, the above embodiments showed the 
structure in which one display device was able to 
display a synthetic screen of multiple windows, based 
on the predetermined layout of the totally four 
independent picture sources including the two 
independent telecast picture sources and two 
independent external picture input sources , but the 
number of picture sources in the present invention can 
be any number greater than or smaller than four. The 
requirement is inclusion of at least one telecast 
picture source and there are no specific restrictions 
on types of picture sources combined therewith. 

The above embodiments showed the cases of 
receiving satellite broadcasting, but the present 
invention can also be applied similarly to reception of 
broadcasting through ground waves, optical fiber 
cables, and so on. 

It is also needless to mention that the present 
invention can also be applies to a case wherein the 
invention is achieved by supplying programs from a 
recording medium (memory) storing program codes of 
software for implementing the functions of the 
aforementioned embodiments , to the apparatus . In this 
case, the program codes themselves read out of the 
memory implement the novel functions of the present 
invention, so that the programs and the storage medium 
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storing the programs constitute the present invention. 

In the above embodiments, the program codes 
indicated in the flowcharts of Fig. 2 , Fig. 7, Fig. 10, 
and Fig. 18 are stored in the ROM being a memory. The 
5 memory for supplying the program codes can be , for 

example, either o£ a floppy disk, a hard disk, a CD- 
ROM, a CD-R, a DVD, a nonvolatile memory card, and so 
on . 

In addition to the case wherein the functions of 

10 the aforementioned embodiments are implemented by 

carrying out the program codes read out by a compxiter, 
it is a matter of course that the invention also 
embraces a case wherein the functions of the 
aforementioned embodiments are implemented in such a 

15 way that an OS or the like operating on a computer 
carries out part or the whole of actual processing, 
based on instructions of the program codes and the 
processing realizes the functions of the embodiments. 
Further, it is also needless to mention that the 

20 invention also embraces a case wherein the program 
codes read out of the memory are supplied to a CPU 
provided in an extension board inserted into the 
computer or to an extension unit connected to the 
computer, the CPU or the like performs part or the 

25 whole of actual processing, and the processing 
implements the functions of the aforementioned 
embodiments . 
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According to the present invention, when the data 
telecast window is displayed as one window of the 
multi-window display, the user can view the window with 
improved visibility of the character area of the data 
5 telecast and the multi -window display, without 

disturbing the "standardized presentation" of the data 
telecast window intended by the broadcasting service 
provider . 



